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Introduction 

Over the past few years state education agencies (SEAs) , local educa- 
tion agencies (LEAs) , and schools have engaged in activities to make 
schools more effective. Many of these efforts have been stimulated by 
research on school and classroom effectiveness. While educational practi- 
tioners may draw upon a common knowledge base (e.g., Block & Burns, 1976; 
Brookover & Lezotte, 1977; Brophy, 1979; Edmonds, 1979; Rutter, et al., 
1979; etc.), their decisions and actions vary from implementation of 
exemplary practices to use of diagnostic or monitoring procedures. Differ- 
ences also occur in the degree of involvement and the nature of the tasks 
undertaken by the role groups involved (e.g., teachers, school-based 
administrators, central office staff, SEA staff). 

In Maryland, the SEA initiated a voluntary statewide program designed 
to apply relevant research to improve instruction and increase student 
achievement. Four research-based innovations were selected for implemen- 
tation: Active Teaching, Mastery Learning, Student Team Learning, and 
Teaching Variables. This prpgram, called^lTIP (School Improvement Through 
Instructional Process), was evaluated by Research for Better Schools (RBS) 
for the Maryland State Department of Education (MSDE) * This paper summarizes 
part of that study covering the first, 18 months of the SITIP program.* 



*For the complete report or executive summary, see Roberts, J. M. E* , 
J&amey, J., Buttram, J., & Woolf, B, Instructional improvement in Maryland: 
A.sftfly of research in practice . Philadelphia: Research for Better 
Schoolk, 1982. - 
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Attention is focused on: 

• the factors influencing the nature and extent of the tasks under- 
taken by each role group 

• the roles and- responsibilities undertaken by each role group 

• the relationships among tasks and role groups 

• the impact on implementation and intended outcomes. 

Evaluation Design 
The initial evaluation design was drafted in the- fall of 1980 (when 
SITIP began), and refined annually. An action research approach was used 
with data analyzed and reported back by RBS to the MSDE team within ten 
days of a critical event or (for the last eight months of the study) on a 
monthly basis. , 

The general areas of activity examined included: training of ff red by 
f * ■ ■* ' / 

MSDE, local plans and planning, local implementation, and technical assist- 
ance (TA) offered by MSDE. Table 1 summarizes SITIP activities in each 
area. Table 2 presents an overview of the data collection for these areas. 
The methods used to collect the data and the data sources listed in Table 2 
are discussed briefly in the following sections. 
Measures and Methods of Dat£ Collection 

Four general methods of data collection were used: observation, 
interviews, questionnaires, and document analysis. 

• Observation . With one exception, all formal training and planning 
events conducted by MSDE were observed.* In addition, the monthly 
meetings of the technical assistants .(TAs) were observed (Movember 
1981 - June 1982) , and two. observations were made at schools in 
each of the eight LEAs selected as pilot sites for th6 study. In 
ail cases, comprehensive notes were taken of activities observed* 



*The exception was the awareness : conference on Student Team Learning, 
January 7, 1981. Inclement weather prevented observer attendance. 



Table 1 



SITIP Chronology of Events 
December 1980 - September 1982* 



In* 



Fam awareness conference* 

»■ * s t ! *;i*Q 3i*^t fVt ituaf pr**i*«v» Us 

w t ! Attaly*!* ol local re*nv*i:*« to 

J inference* and of proposal* 

Planning \ *o»f spring planning sessions 
j 

j Analyses &l local response to 

! *prlf*K planning 4u$*1p»« 

j Four surfer instltucc* 
I 

I fall planning session 



Assess-e^t 

Trail* I -ns 
P Iannis* 



Technical 
Assistance 



Follow-up training sessions 
CI or 2 per Innovatlnn) plus 
n5>-5»Uu' coaching etc. 



*aa;v#t4 progress ec'datv 



Itt-UaUm to update or refine 



Attendance **f tcans at a*/*ireiie?»5 
Ce»»tferc»fc* * 

S»|ii"J«. ..r .1 of itrujv»ial»i fl'J Ma»») 



Attendance .u spring planning 
sessjUn* 



Attendance at Institutes 

Attendance at session, revision 
of plan* 

Attendance at follov-u r * 



Use oi one or norfc Innovation! 
(19 LTAs) 



Review *i rtttdHv* 

Revision of plans (plus inclusion 
or 5 core U*as) 



ttotu* 

Juir - i>ctisber isSf 
October * j*- »'* 

neeuf ter I9?0 - , 

^nrfis * V,*r»l IV!*: 
April vm 

April - *uy I9fel 

r!ay Ui3l 

June ~ lulv l¥Sl 
September - 4 t*.*.~aer 

Sept. 1981 - Susu 1- 

Sept. W81 - June l tt 

Oct 1*81. then r.%-'» 

Autust 19S2 . 

August - Stpto i 



— — SM^^^^ 



t« c!u« hj%M««lhR M tite l9Si school j-eir. 



Table 2 

Overview of Data Collection (1980-82) 





Question Areas 


Heasu res/He thods 


Source 


Fretfuency/Ti*e 


U Training offered 
by HSDE 


- observation* 


conferences 
sucrser Institutes 
follow-up sessions 


. 4 (Dec. 19*0 - Feb, 1981) 
4 (June - July 1981) 
$ (Dec, 198^ - Hay 1982) 




- queitionniiltco 


participants of all 


H (Dec, 1980 - May 1982) 



local plana and 
planning 



3. local implementation 



stages of concern 
questionnaire 

document analysis 

observation 

quei tlonnalre 



4, TA of f« rtd by HSblT 



- document analysis 

- observations 

- follow-up feedback fort* 

observations 
• interviews 

- observations 

- interviews 

- phone inr rvievs 

- stages of concern 
questionnaire 

- gene Ml survey 

- docuoent analysis 

- obiervationa 

- follow-up feedback fora 

- observation^ 

- interviews 



participants of conferences 
and summer institutes 

local plans/proposals 

otate-lcd planning sessions 

participants of planning 
sessions 



2 flteb, 1981 & 3uly 1981) 



i : 



phone interviewi 
general survey 



public plana* reports 

participants of follow-up 
sessions 

staff of pilot sites 



H$&Z TA staff monthly 
greetings 

ITK key contacts 
J All participants (455) 

| HSDB TA aeefFIog~"T 

follow-up 'session 
paeticipanta 

HSDE TA staff monthly ' 
meetings 

htA key contacts 
all participants 



2 (May 1981 S Ker. 1982) 
5 (Spring a fall 1981) 
4 (Spring 1981) 



On-going 

6 (1 or 2 per topic as 
scheduled) 

16 (2 per pilot site ae 
scheduled) j 

8 (1 per month) 



20 (Feb, - Kar. 1982) 
1 (Hay 1982) 



8 (1 per ©onth) 

6 (1 or 2 per topic as 
scheduled) 

8 (1 per month) 



20 (Feb* - Hsr, 1982) 
~t "HFfay T9821 <C 





# Interviews , Structured* semi-structured, and open-ended "interviews 
were conducted with the aight MSDE TAs and with school and central 

• office staff at the pilot sites. In addition, the 19 LEA project 
directors were interviewed once by phone early in 1982 * 

# Questionnaires . Five types of questionnaires were used^ 1) Stages 
of Concern Questionnaire (developed at the Research and Development 
Center for Teacher Education, Austin Texas, 2) Awareness Conference 
and Summer Institute Evaluation Forms, 3) Follow-Up Feedback Form, 

a 4) Technical Assistance Survey, and 5) General Survey. 

# Document Analysis ; Four kinds of materials were systematically 
reviewed; 1) articles about the four innovations (used as advance 
reading for conference participants) and materials used by the 
developers for, training users at institutes and follow-up sessions; 
2) materials developed by LEAs for inservice or classroom use; 3) 
plans developed by LEAs as proposals requesting funds (May 1981) 
and as descriptive summaries reflecting revised or refined ideas 
(September 1981); and 4) logs maintained by MSDE'TAs recording all 
their SITIP-related activities (from telephone calls to follow-up 
sessions). 

Respondent Population # 

Maryland's SITIP program Was offered to all 24 LEAs — Baltimore City 



plus 23 counties. Nineteen LEAs submitted proposals and subsequently 



implemented their plans. Each local team included (at least) a project \ 
director (usually central office staff), a school-based administrator, and 
two teachers. 



Eight of the 19 LEAs were asked to cooperate as pilot sites for the 

purposes of this study, which meant that in addition po responding to 

*% 

questionnaires and the project director telephone interview, participants 
provided copies of locally developed materials, and hosted RBS observers 
for two on-site visits. 

lit the fall, of 1981, local pl^ns predicted that in 19 LEAs, at 58 
schools, 626 teachers would have implemented SITIP topics by the end of the 
school year. By May 1982, 455 directly-involved implementers were identi- 
fied and asked to respond to thft general survey. Three hundred twenty-nine 
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respondents completed arid returned the survey, At the state level, informa-i. 
tlon was provided by the eight MSDE staff assigned to provide technical, 
assistance, and by the assistant deputy superintendent who coordinated. 
SITIP activities. 

Results 

While the focus of this paper is on responsibilities of role groups 
involved in instructional improvement, it is useful to examine the context 
in which those activities occurred/ Therefore, this section first discusses 
factors influencing roles and responsibilities, and then discusses responsi- 
bilities undertaken by each of the four role groups, in terms of planning, 
training, implementation, support/ technical assistance, assessment, and 
dissemination, * - 

Factors Influencing Roles arid Responsibilities 

There were four main factors influencing the roles and responsibilities 
of SITIP participants: 1) the nature of the innovation -- its demands and ' 
relative complexity; 2) the implementation strategy — whether it was 
school or district-based, using a capacity building, pilot/district, light- 
house, or district-wide approach; 3) the organizational nc-rms — local 
characteristics which determine decision-making and communication practices; * 
and 4) the scope and intensity of implementation. 

Nature of the Innovations , Four research-based innovations were 
selected by MSDE as potentially useful to all schools for improving instruc- 
tion in all structured academic curricula.. They were: Active Teaching, 
Mastery Learning, Student Team Learning, and Teaching Variables, 

10 



Active Teaching (AT) is a system of direct instruction developed by 
Thomas Good and Douglas Grouws ac the University of Missouri. 
Originally designed for the teaching of mathematics, AT consists of 
the following components: 1) pre~lesson development — concepts and 
skills from the previous night* s homework are reviewed, homework is 
checked and collected, and students engage in mental exercises; 2) 
lesson development — prerequisite skills .and concepts are briefly 
reviewed $ new concepts are introduced vis teacher ^explanation and 
demonstration, and student comprehension is assessed through 
controlled practice; 3) seatwork uninterrupted, individual, 
successful practice is provided in order to increase proficiency in 
the skills and concepts taught; 4) homework — homework is assigned 
related to the concepts developed that day; and 5) review/maintenance 
— weekly and end-of~unit reviews help to maintain skills and 
concepts taught, 

Mastery Learning (ML), developed by Benjamin Bloom and James Block, 
combines curriculum alignment and diagnostic/prescriptive instruction 
with a philosophy that all students can succeed* Essential component 
are: 1) developing a scope and sequence of objectives, broken down 
into prerequisites and component skills; 2) providing appropriate 
instruction aligned with the objectives to be mastered; 3) testing 
the student f s progress in mastering the objectives through the use 
of a formative evaluation measure; 4) providing students who have 
not achieved mastery with additional corrective work in the deficient 
areas specified by the formative tests, and providing students who 
have achieved mastery with enrichment activities to reinforce and 
supplement learning; 5) testing final mastety of the objectives 
with a summative evaluation measure; and 6) recording student 
progress in terms of individual mastery of specific objectives. 
"Mastery" is usually defined as 80% of the students demonstrating 
success on at least 80% of the objectives in a given unit of 
instruction* 

Student Team Learning (STL) techniques use peer tutoring and team 
competition to facilitate student learning. Student Team-Achievement 
Divisions (STAD) and Teams-Garaes-Tournaments (TGT) were developed 
by Robert Slav in and staff at the Johns Hopkins University. Jigsaw 
was started at the University of Texas by Elliott Aronscn who is 
currently at the University of California at Santa Cruz, The key 
factors of STL are peer interaction, cooperation, and competition. 

Teaching Variables (TV) was developed by David Helms and staff at 
Research for Better Schools (RBS) ; Two variables found to be 
strongly related to effectiveness of instruction and student 
achievement were identified: "content" and "time." The "content" 
variable encompasses two factors: 1) assessment of prior learning, 
and 2) alignment of curriculum objectives and classroom instruction 
to the testing instrument. The "time" variable improvement cycle 
involves: 1) measuring student engaged time (SET) via classroom 



observation, 2} comparing SET £nd opportunity for improvement, 3) 
reviewing and selecting research-baged improvement strategies, 4) 
implementing strategies, and 5) evaluating the effectiveness of the 
strategies in improving SET via additional classroom observations. 

The innovations vary in complexity* Complexity was determined on four 
criteria: 1) knowledge — - how much that is new must be learned? 2) materials 
— how much do classroom materials need to be redesigned or developed? 3) 
methods — how much change is required in the way trhings^are done in the 
classroom and in the school? and '4 ) organisation — how much role change 
and administrative action are required? Each innovation was rated on a 
scale from 1 to 5 (with 5 indicating high complexity) on each criterion, < 
and a jnean rating was assigned. (See Table 3.) As designed, the innova- 
tions in order of complexity are: Active Teaching (1.62), Student Team 
Learning (2.^7), Mastery Learrflng (3.12), and Teaching Variables (3wf/)< 
As implemented, Teaching Variables was less complex than Mastery Learning 
since 60% of TV implementers used only the "time" variable. 

Table 3 

Complexity of the SITIP Innovations 



" q ^ , ^^^Ta p i c 
Dimension"""" — 


AT 


ML 


STL 


TV 


knowledge 


"1 


3 


3 


5 


materials 


2 


4 


3 


3 


methods - in class 
- in school 


V 1 - 5 


4 >3.5 




3 \ 3 


organization 


.1 


2 


l 


4 


cocal 


6.5 


12.5 


9.5 


15 


mean 


1. 62 


3.12 


2.37 


3.75 



Mean ratings vary from a high of 5.00 to a low of 1.00. 

AT « Active Teaching,. ML « Mastery Learning, 

STL « Student Team Learning, TV « Teaching Variables 
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AT and STL, -as implemented, were simple and classroom-based requiring 
less support from school administrators and central office staff than ML 
and TV. ML and TV were complex and school-based, requiring' cross-hierar- 
chical coordination . 

In looking at ths data on effort expended, and comparing innovations, 
the following should be keprt in mind: 

o Active Teaching ; Strategies required active involvement from all 
role groups* The innovation as implemented was simple and class- 
room-based. Scope was larger than for any other topic, (33 schools, 
472 teachers) . 

© Mastery Lea rning: Strategies were school-based. The. innovation as 
implemented was complex and suggested a need for cross-hierarchical 
coordination. Scope was moderate (81 teachers in six schools), 

* Student Team Learning : Strategies were primarily teacher-oriented 
or classroom-based with initial involvement or light monitoring by 
school administrators and central office staff. The innovation as 
implemented was fairly simple and classroom-based. Scope was 

e moderate (1G0* teachers in 20+ schools). 

d Teaching Variables : Strategies were primarily school-based with 
active involvement by central office staff in three of the' five 
LEAs. The innovation as implemented was moderately complex suggest- 
ing a need for interaction between observers and teachers observed. 
Scope was low (50+ teachers in six schools). 

Implementation Strategies . Level of effort (i.e., time and energy an 

LEA was willing to invest), role group enthusiasm, and perceived local need 

seemed to be the three* strongest factors influencing LEA selection of am 

implementation strategy, of which there were fours 1) district-wide, 2) 

pilot/district, 3) capacity building, and 4) lighthouse school. 

* The district-wide strategy was used by one LEA implementing AT in 
all 26 elementary schools. This strategy demands the greatest 
level of effort, (because so many people are involved) j high enthu- 
siasm by central office, staff (transmitted to other role groups); 
and perceived need by all role groups (especially the superinten- 
dent). Since AT was the least complex innovation, district-wide 
implementation was feasible given available resources. 



• The pilot/district strategy involves one or a few schools in the 
first year with commitment from central office to become actively 
involved in dissemination/implementation to many more schools in 
subsequent years. Four LEAs used this strategy; one for each 
innovation. This strategy requires effort and enthusiasm from all 
involved, particularly central office staff who usually take 
responsibility for involving additional schools after the first 
year. The extent of involvement and progress within the pilot 
schools was related to innovation complexity, with greater expan- 
sion probable for less complex innovations. 

• Capacity building is essentially a staff development approach which 
encourages voluntary implementation following training conducted by 
those first involved with SITIP. Five LEAs selected this strategy 
---four for STL and one for AT. Training was conducted mostly by 
teachers at three sites, mostly by central office staff at the 
other two LEAs, with school administrators also involved in two 
counties. The innovation developer also assisted in training at 
three of the STL capacity building sites. Both innovations imple- 
mented through capacity building (AT and STL) are classroom-focused 
and are less complex than ML or TV. Success related to the effort 
invested in training, not only in workshops but also in follow-up 
assistance. 

• The lighthouse school strategy, used in 13 schools by ten LEAs, 
focuses implementation of an innovation in a single school. 
Success may be broadcast informally and additional .schools may 

^ elect to adopt the innovation, but no formal commitment is made by 

central office staff to actively encourage or train others. The 
strategy was used for AT at two sites, for ML at five sites, for 
STL at three sites, and for TV at four sites. Diverse patterns of 
interaction and leadership evolved for this strategy, ranging ffom 
a small teacher-centered project to a cross-hierarchical team 
effort. 

The relative value of a given strategy (in terms of institutionaliza- 
tion from a local perspective, or of Widespread use from a more general 
perspective) cannot yet be determined but may become apparent in the second 
year of implementation. The strategy determines how the work is shared 
among role groups. 

Organizational Norms . The term "organizational norms" was used to 
describe local characteristics which, determined decision-making and communi- 
cation practices. For instance, LEAs differ in degrees of formality, 



14 



to' 



extent of "top down" authoritarian control or school-based autonomy, and 
these differences influenced participants 1 expectations and behavior. When 
local norms did not facilitate SHIP implementation (e.g., when designated 
"leaders" were not accustomed to participatory planning, or assumed that 
implementation would occur with little need for their support) problems 
arose unless MSBE TAs intervened. Organizational norms had a strong 
influence on communication among role groups and on interactive support, 
which in turn, influenced attitudes (particularly the commitment of 
teachers) , . 

Scope and .Intensity of Implementation . During the 1981-82 school 
year, 19 Maryland school systems were involved in SHIP, 15 implementing a 
single innovation and four implementing two or three innovations. Over 65 
schools were involved, with more than 688 teachers working with over 886 
classes in all grade levels. (See Table 4.) 

♦ School Sites . All types of schools were involved, with all grade 
levels from kindergarten to twelfth grade. Most teachers were 
voluntarily involved, but in one county all elementary teachers 
were required to implement AT, and in some other counties teachers 
were expected to participate. Contrary to conclusions drawn in 
other studies, no greater difficulties were experienced in second- 
ary schools than in elementary schools. The 16+ secondary schools 
were involved in all strategies except the district-wide approach 
and used all four innovations and a variety of content areas. 
There were two differences between types of school during implemen- 
tation: 1) secondary teachers were more likely to focus on curric- 
ulum and elementary teachers were more likely to focus on grade 
level; and 2) while principals were involved in both kinds of 
schools, if an additional "leader" was needed it was somewhat 
easier in secondary schools for a department head or teacher 
coordinator to have "free" time than for elementary teachers to 
have necessary arrangements made. However, both groups did attend 
to curriculum and grade articulation, especially for ML and TV, 

• Curriculum Subjects . For three innovations (AT, .ML, and TV), 
developers recommend implementation in basic skills, with AT 
focusing on mathematics and ML adding science. Academic curricula 
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Table 4 

All Innovations as Implemented (1981-82) 



I i — 1 — . 

* 

1 

Topic 


#LEAs 
Single 

School Multiple 


//Schools 


^Teachers 


^Classes 


Grades 


Subjects 


Active Teaching 


4 


1 


33 


472 


514 


1-12 


M, R/LA, Sc, 


SS 




Mastery Learning 


4 


2 


6 


81 


93 


K-12 


M, R/LA, Sc, 


SS, 


Other 


Student Team 




















Learning 


4 


4 


20+ 


105+ 


177+ 


K-12 


M, R/LA, Sc, 


Ss, 


Other 


Teaching Variables 


3 


2 


6 


51+ ' 


58+ 


1-12 


M. R/LA, Sc, 


SS, 


Other • 


TOTAL 


19 


65 


688 


886 


K-12 


M, R/LA, Sc, 


SS, 


Other 



Key: M « Mathematics 

R/LA * Reading/Language Arts 
Sc « Science 
SS * Social Studies 



are considered most appropriate fox* all four innovation** Tho wnv 
popular curricular areas wove** reading/ language arta 1 1 7 l,KA*0 * 
mathematics (16 LEAs) , science (12 LEAs) , and social studies 
(11 LEAs) . Participants indicated that greater student impact and 
acceptance by teachers occurred when innovations were used for 
fairly structured curriculum. 

* Scope and Time . The innovations were implemented from between one 
month to the full school year, Within the implementation time the 
scope of use ranged from 5% of the time allocated to a curriculum 
for a given class, to 100% of " the allocated time. Most time was 
spent for AT and ML on more structured curricular areas such as 
mathematics. Where STL was implemented some teachers used the 
innovation sporadically. Ten LEAs used the innovation for at least 
50% of the time allocated for the selected subject area for at 
least five months. 

The overall scope and intensity of implementation (number of schools 

teachers, curriculum areas, and time used) were determined largely by the 

Strategy selected, but also reflected the LEA felt need or commitment to 

the innovation* Planned scope was reduced during implementation if resources 

dtfiipe and energy) became scarce, 

Roles and Responsibilities of State Education Agency Staff 

Following a summary of the overall SITIP design, SEA activities are 

described for each of, the following areas: planning, training, technical 

assistance, evaluation, and dissemination/expansion. 

Overall Design . SITIP was designed by the SEA as a multi-year program 

consisting of interactive activities which are outlined below and presented. 

in Figure 1* 

^ Preparation (open systems planning): Identify needs and potential 
.solutions. Identify operating constraints and opportunities, 
particularly existing programs or policies that" could form a basis 
for action. Draft a design to apply solutions to needs within 
operating constraints, but with flexibility for improvement if 
necessary. Take care of logistics. 

2 * Initial Commitment : Review plan with LEA superintendents. Get 
commitment for local, team attendance at awareness conferences. 
Bis tribute advance reading materials to participants, 



HSOE Preparation 
(open-systems planning) 



Initial Cofrniltment 
(of local teams! 



\ 



Awareness Conferences 
(concent and design 
information) 



Technical Assistance 
(coaching) 







| Local Proposals and Plans 
(vith allowance for biannual 
or annual up-dates) 







Foliov~up Training 



As*»essm^nt of Progress 
aiujt_ Impact 



Implementation 



Dissemination 
(expansion) 



Figure 1. Thti SITIP Design: An Interactive Modal for Program Improvement 



3* Awareness Conferences (content and design information): Have each 
of the instructional improvement processes presented by its 
developer at awareness conferences attended by LEA -teams, MSDE 
staff, and interested others* Describe design and nature of « 
(voluntary team) involvement. 

4* Local Proposals/Plans ; Help LEAs draft proposals to implement one 
or more of the processes* Negotiate revisions as needed at the 
beginning of each school year to enhance useful implementation* 
Encourage cross-hierarchical participation in decision-making and 
realistic timelines and scope for implementation planned, 

5* Implementation (incremental application): Help LEAs implements > 
.selected process(es) using their own strategies but involving 
representatives of all role groups* Encourage innovation fidelity 
but allow adjustment of scope if necessary* 

6* Dissemination (expansion): Encourage use of the processes in. many 
f schools, and share information about successes between LEAs* 

7 * Technical Assistance (coaching) : Assign MSDE staff (across divi- 
sions) to assist LEAs in planning, implementation, and dissemi- 
nation; to conduct follow-ups; and to facilitate networking. 
Build capacity^ do not create dependency, 

8* Follow-up Training ; Conduct ail intensive three-day training 
session on each process for prospective impleraenters (teachers, 
school administrators, central office staff)* Conduct annual or 
bi-annual follow-up training sessions (using participatory planning) 
to maintain, quality implementatioft* Assist LEAs (central office 
staff) in planning/conducting turnkey training. 

9. Assessment of Progress and Impact (cyclic): Have a * f third party 
evaluato^ 1 collect and analyze data systematically and use (feed- 
back) information to makeo improvement^ and publicize- successes* 
(Data on local needs and concerns ar<* of particular importance in 
planning/implementing every activity};) 

'Planning * , A MSDE planning began in mid~l$80 when a preliminary design 
was developed* Following a systematic search for research-based instruc- 
tional processes and consideration oi; the research on educational change, 
decision** were made to invite LEA reactions. Planning activities are 

illustrated by the following review of critical events involving LEAs. . 

,./■', 

# In the fall of 1980, original MSDE plans were complete, LEA super- 
intendents had reviewed the design, and 20 had agreed to send local 
teams to the four Awareness Conferences* 
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* Following the Awareness Conferences local teams were invited to 
develop proposals to implement one . or more of the four innovations* 
Nineteen proposals were submitted by April 1982, most of which did 
not reflect sufficient understanding of the processes to suggest 
successful implementation* 

• In May 1982, MSDE staff conducted planning meetings for each 
innovation at which LEA representatives stated the needs they 1 
wanted addressed at the summer training institutes* MSDE staff 
also addressed some of the issues suggested by the local proposals* 

# In September 1981,. after the summer training, LEA teams weire asked 
to meet with MSDlNu^ff for a day to revise or clarify plans and 
develop summaries using PEPS forms. This was done became 1) the 
summeit training had resulted in some LEAs deciding to adopt other 
innovations or make other revisions to their plans, 2)' the LEA 
superintendents wanted to see a complete collection of the plans in 
a concise common format, and 3) MSDE staff assigned as technical 
assistants wished to meet with local teams to plan iollow-up 
activities* 

In addition to the above critical events, MSDE planning included involvement 
of senior MSDE staff (division directors) in decision-making s and monthly 
"review and refinement 11 discussions by the SITIP TAs under the leadership 
of the SEA assistant deputy superintendent* These discussions' were influ- 
enced by findings presented in interim evaluation reports, by the field 
experiences of the TAs, and by. ideas of senior MSDE staff (e*g., to link 
SITIP with other programs or areas such as Chapter I or teacher training by 
institutes of higher education)* MSDE staff involved in SITIP planning 
based both content and process of the program on relevant research, reviewing 
(on an on-going basis) literature on the innovations, on school and class- 
room effectiveness, and on planned change. 

■* Training * Training was provided by MSDE at three points in the 
program; 

# Awareness Conferences were conducted „at two-week intervals begin- 
/ ning December 4,^1980, LEA superintendents from ,20 of the 24 LEAs 
agreed to send cross-hierarchical teams to all four in order to 
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determine whether they wished to implement any of the topics . MSDE 
staff and faculty of institutes Qf higher education were also 
invited. Advance reading materials were sent in November to all 
300 invited guests . Each conference focused on one innovation and 
each was conducted by the developer, or research team who designed 
the innovation. , 

» As part of the follow-up training for each innovation, developers\ 
conducted a three-day Summer Training Institute for local implemetfr 
tation teams and a one-day orientation session for MSDE staff* 

* Subsequent follow-ups were designed and conducted by MSDE TAs for 
innovation implementers according to their needs. All included * 
local "share and tell' 1 sessions which facilitated networking, and 
three involved outside "experts" 'who clarified, innovation elements 
and reinforced SITIP validity. For STL, each LEA team attended two 
follow-ups (with the second including classroom observation of 
STL), for AT and ML, teams attended a two-day "retreat," and for 
TV, each LEA team met once with two or three other teams that were 
geographically close by. , 

Training activities required considerable resources in te rms of time, 
energy, and consultant fees. Factors contributing to some degree of 
dissatisfaction or only partially accomplished objectives included: 
inadequate communication of expectations (aimong participants and to pre- 
senters) ; insufficient attention by presenters to expressed needs of 
participants and to practical implications for implementation? insufficient 
opportunity for participants to share their ideas and concerns; and too 
much information or "off topic" information presented given available time, 
needs* and energy. Factors contributing to Success included: credibility 
of presenters and validity of topics} use of time that allowed for varied 
activities, media, and interactions; clearly understood expectations by all 
involved J attention to participants 1 needs (in -preparation) and to their 
interests and concerns (during the event); and use of focused, relevant, 
practical information with a sound knowledge base. 
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Technical Assistance , The technical assistance associated with SITIP 



was initially perceived as training (i'.e., follow-up workshops), but was' 

redesigned (e.g., to include on-site trouble sfeooting etc.) to meet local 

needs. In the summer of* 1981, eight MSDE staff (two per innovation) were 

assigned to provide technical assistance. Drawn from six different MSDE 

divisions, TAs each expected to spend about two days a month on SITIP. 

Their activities were coordinated by the Assistant Deputy Superintendent 

(ADS) * Their major objective was to facilitate implementation of local 

plans by providing information, building an interactive communication 

network, conducting training, and providing on-site assistance. 

♦^' General administration and budget were primarily the responsibility 
of ADS, who invited TAs to make requests or recommendations about 
allocation of funds (e.g. , for follow-up sessions) , and to partici- 
pate in decision-making. Each TA partnership was responsible for 
monitoring LEA use of grants (an average of $5,000 per year per 
LEA) , . and for efficiently managing resources allocated for mater- 
ials and training for a giv&n - innovation. General administrative 
and budget tasks were carried out by the ADS and administrators 
usually reporting to him (bite of whom is "outside 11 the TA system) . 
Combined effort of the TA6 on administration and budget took less 
than 5% of their time spent on SITIP. 

# Planning was an on-goirig process and urred in several ways. At 
the monthly TA meetings members reviewed progress and planned 
improvements. They learned from each other how to facilitate local 
implementation, and they also looked for Ways to coordinate SITIP 
with other state initiatives or educational groups. By mid 1982, 
planning concerns were both short-term and long-term, individual 
TAs offered more ideas, and some advocated various ways to. coordi- 
nate SITIP with other activities and groups. The ADS involved 
members of the MSDE Instructional Coordinating Council (ICC) in 
planning by keeping ICC members informed and by inviting their 
input; * 

• Training (from a system perspective) included the three kinds of 
MSDE-initiated activities described in the chapter on training in 
this report. In addition, after each of the Summer Institutes and 
before the 1982 Conference the developer/presenters conducted 
training sessions which were open to all MSDE staff. SITIP TAs 
assisted in planning and participated in Aese events if they were 
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involved with SITIP at the appropriate time., This task area took 
about 22% of the TAs 1 SITIP time, with almost all spent on design- 
ing, organizing* and conducting the follow-up sessions ♦ 

General support tasks took about 10% of the TAs* time and were the 
most frequent kind of interaction between LEAs and TAs. Most 
interactions were information exchanges- or problem-solving discus- 
sions, while others were requests for materials or innovation 
clarification, and some focused on logistics such as making 
arrangements for site visits ♦ Interactions were almost all by 
phone > each required individual attention by the TA functioning as 
the key contact, and several required subsequent action such as , 
linking LEAs with similar . interests or obtaining and sending 
materials . 

Site visits took over 40% of the TAs f time, since each innovation 
site was visited at least twice during the 1981-82 school year* 
These visits were no£ for compliance monitoring although TAs did 
gain -an understanding of the nature and extent of implementation at 
each site* In som^ cases TAs conducted training or assisted 
central office staff in designing or conducting training* TAs 
always visited classrooms and usually talked with all three LEA 
role groups* They collected copies of locally developed materials 
and distributed others* They participated in trouble shooting to 
address concerns of one or more role groups, and exchanged ,f good 
ideas 1 ' learned at other sites or from innovation developers. They 
helped LEAs contact developers when necessary* In general, they 
provided resource support (money, materials), technical support 
(expertise, tr&ining) , process support (ideas about alternative 
ways of getting things done), and affective support (recognition . 
and acknowledgement of local efforts)* Individual style or degree 
of formality varied, but all TAs understood local norms and observed 
local protocol, and most tried to establish colleagial relationships 
with local educators* 

Evaluation of SITIP was conducted by RBS* TAs did not evaluate 
local implementation* Each LEA was responsible for evaluating 
itself. Since local expertise in evaluation was varied, and since 
it was not. cost-effective for each LEA to duplicate efforts in 
development of measures etc., the TAs explored ways to build local 
capacity without increasing effort invested. 

Commun i cation within the TA system was j interactive. Communication 
between SITIP and other organizational! groups was important because 
SITIP was designed as a collaborative Effort, and because if it was 
to survive and grow it could not have rproject 11 status but should 
be incorporated into or coordinated with related instructional 
activities. Since the TAs were drawn from five MSDE divisions and 
the Office of Project Basic each could Wet as a boundary spanner* 
TAs spent 10% of their time maintaining communication with each 
other and with coordinating groups. This time included system 
planning and some knowledge building. ' 

9 
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# Dissemination is defined here as involving or informing others 
about SITIP, beyond those intended in the original plan* .To date, 
SITIP TAs have been involved ^in two dissemination activities* 1} 
they assisted ADS in making presentations at a Regional' School 
Improvement Conference, and 2) they exchange information with 
developers and conference presenters who in turn tell others' about 
SITIP (subsequently resulting in inquiries from other htktes) . 
These activities took about 6% of the TAs time over the. seven-month 
period. Plans are underway to involve professional associations, 
and to increase involvement of institutes of higher education. 

* Problems TAs experienced included: competing responsibilities, 
demands on their time, and sonie initial confusion in adjusting 
workloads., 

* In working with LEAs, TAs had to learn to deal with bureaucracy, 
develop non-standardized strategies and materials to satisfy 
varying local needs, discourage competition, and maintain energy 
and enthusiasm, 

• A task orientation and drive toward social power (democratic shared 
leadership for the benefit of the local implementers) were appropri- 
ate for effective delivery of technical assistance. Incentives 
included evidence of group success, acknowledgement by supervisors 
of TA efforts, and opportunities to learn more or take on addi- 
tional responsibilities* 

<a The nature and extent of local implementation would have been 
considerably less without the TAs', They provided information and 
encbr *,gement, established networks and shared successes, and 
crossed hierarchical boundaries to help LEAs resolve problems. 
Their efforts were well-received" by local educators with who*- thay 
interacted, since the TA role was -quickly understood and appreciated 
by almost everyone 1 

Evaluation » Assessment of progress and impact was conducted by RBS 
using an action research approach in which data were analyzed and reported 
back to MSDE frequently. The study addressed both MSDE and LEA activities . 
Four general areas addressed were: 1) training, 2) planning, 3) local 
implementation, and 4) technical assistance* (Measures and methods are 
outlined earlier in this paper.) 

Dissemination/Expansion . Expansion of SITIP is occurring in four 
ways; 1) involvement of all LEAs and involvement of more schools and 
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teachers in implementation; 2) annual statewide instructional leadership 
conferences, 3) knowledge and capacity building for system-wide instruc- 
tional improvement, and 4) information sharing with institutes of higher 
education. Each is Summarized below* 

i 

0 As of October 1982, all 24 LEAs were implementing one or more .of 
the four instructional innovations. The MSDE technical assistants 
are encouraging expansion within sys terns ^and state funding con- 
tinues through the 1982-83 school y*:ar. 

0 In April 1982, the statewide co^fcswence included presentations by 
Barak Rosenshine (on classroom effectiveness research) and Robert 
Bush (on staff development)* Over 300 Maryland educators attended 
the conference, some of whom were already involved in SITIP. The 
1983 conference will include presentations by Karen Seashore Louis 
(on planned change) , Madelaine Hunter (on effective teaching) , ahd 
local SITIP teams (on the four innovations) . 

o To facilitate the development of a common knowledge base, a research 
synthesis on classroom and school effectiveness and planned change 
was developed. The paper .( Instructional Improvement: A System-Wide 
Approach ) was distributed to MSDE and LEA assistant superintendents, 
MSDE Title I staff, SITIP technical assistants, and Project Basic 
facilitators. Sach group participated in a conference or seminar, 
and participators were encouraged to share relevant information with 
other educators or^ incorporate ideas into existing programs. 

& In order to exchange information with institutes of higher educa- 
tion, MSDE initiated a series of conferences in the 1982-83 school 
year focusing on research on teacher effectiveness. Information 
about SITIP was included* 

Summary . In general, the SEA role was that of resource coordinator, 
with resources including not only funding and technical assistance but also 
a sound research base and a system of data-based decision-making. The 
coordination reflected a philosophy Of cross^hierarchical communication and 
voluntary participation with a clear SEA initiative. 
Roles and Responsibilities of Local Educators 

Within each LEA three main role groups were identified: central office 
(CO) staff; school-building administrators (SA) , who were principals, vice 
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principals or secondary school department heads; and teachers ♦ In subse- 
quent sections of thia paper roles and responsibilities of each of those 
role groups is discussed, Here, some general findings are presented. 

The following discussion addresses the areas of planning, training, 
and implementation. It i$ important to note that each LEA was free to 
chose any or all of the four innovations, to develop its own implementation 
strategies, and determine scope' and intensity of use, "Success" is related 
to the needs and intentions of each LEA*' 

Planning » Elements of planning that had a direct relationship to 
successful implementation included: 1) cross-hierarchical participation, 
2) cyclic interaction with training and -assessment to allow for data-based 
decisions, and 3) alignment of innovation(s), scope, and n implementation 
strategy in relationship to local interest and resources. These elements 
were influenced by local organizationalx norms. * 

Training . As agreed by the superintendents of the 19 LEAs, training 
events conducted by the SEA were attended by cross-hierarchical teams, with 
over 50% of the individuals attending two or mote of the three events,. 
Thdsfr trained by the SEA frequently trained others in their LEAs, Local 
teains influenced the summer institutes and -follow-up sessions fcy discussing 
.their needs and concerns with. SEA staff designing those events, Feedback 
data indicated that most expressed needs were met. 

Implementation , Local implementation has been discussed in terms of 
strategies and scope and intensity early in this paper, Here/ the focus is 
on participation, activities and levels of effort, interactive support, 
perceived impact, and participant needs and concerns* Participation in 




M3DE~initiated planning and training events by local educators impacted 
implementation: 

m Sustained involvement of specific individuals was important to 

maintain ccmMnutty. At six sites (four lighthouse schools and two 
capacity h^il^ing LEAs) no one sustained participation in al.l six 
activi^iesT^At three of, those sites problems resulted: 1) lack of 
£^rSness of related activities in other LEAs stressed within-LEA - 
f^eBon^^i^^m^B^ networking support), and 2) commitment and 
1 energy to Miplement were relatively low, 

9 J Where role g^nip participation was adequate (i.e. , involvement in 
at least two training and two, planning activities) fewer communica- 
tion problems occurred (all but one LEA) . 

• Where role group participation was adequate and at last one person 
from each role group sustained involvement in all activities, the 
only implementation problem that was apparent related to scope, 
i.e., plans were slightly more ambitious .than could be carried out 
(two ML sites) . 

* Where role group participation was adequate and the person(s) 
assuming leadership sustained involvement (12 LEAs), few implementa- 
tion problems occurred as long as leaders shared information with 
others. 

Levels of effort (time and energy) were estimated (on a scale of 0 
none to 6.00 — a great deal) by CO staff and school administrators for six 
given areas of activity: 1) administration (including planning and budget), 
2) development of materials, 3) designing and/ot conducting inservice, 4) 
supporting school-based implementation (e.g., problem solving, supplying 
materials), 5) dissemination, and 6) evaluation* Overall patterns of level 
of effort were similar across innovations, with the least difference for 
inservice. All three role groups also rated work required* by SITIP in 
comparison to other similar innovative programs, using a scale of 1.00 
(substantially less time) to 5.00 (substantially more time) for five 
activities: 1) becoming informed, 2) interacting with school personnel, 3) 
preparing or organising materials, 4) record keeping, and 5) evaluation, 
Specific findings are presented later for each role group. 
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Given the domirant strategies and the relative complexity of the 
ations as implemented, the followinfeooints are of interest:- 



• Active Teaching made greater demands on the people organizing and 
supporting, implementation than it did on the teachers using it, 
with the greatest combined effort spent on learning/ training for 
innovation use, and supporting implementation through staff inter- 
action. Teachers found AT relatively undemanding. 

• Mastery Learning made more demands on teachers than on other role 
groups, although both school administrators and central office 
fftaff spent time on becoming informed, on interactive, support, and 
on administration, 

• Student Team Learning was more demanding for school-based staff 
than for central office staff, with most combined effort spent on 
learning/ training and interactive support. 

• Teaching Variables was relatively undemanding for school-based 
staff, with central office staff spending most time on interactive • 
support and learning about the innovation. 

• The average investment of effort, combining all role groups per 
innovation, related to the complexity of the innovation as " 
implemented, with most for ML, followed by TV, STL, and AT. 

• The patterns of investment (how work was shared among role groups) 
were related to the Implementation strategy used for all innovations 
except TV. (In that case the nature of the innovation influenced 
patterns depending on who carried out the observation tasks. This 
decision was influenced by the organizational norms of the LEA.) 

- The implementation strategies selected and the complexity of the 
innovations as implemented largely determined the nature and extent of 
interactive support. A third influential factor was individual commitment, 
demonstrated by initiative, encouragement of others, and taking on work- 
thai: needed to be done. These (leadership) behaviors were sometimes 
demonstrated by CO staff or school-based administrators, but were also 
apparent in people with no formal authority, flor an innovation to be 
successfully implemented/ each site needed an advocate or team perceived by 
local participants as being "in charge." Problems occurred when! there was 
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uncertainty about project leadership and when school-baaed staff were not 

i 

informed of central office plans or decisions or did not receive materials 
sent to "central S^f ice by HSDE or topic developers. Positive affect and 
high productivity were likely when everyone understood what was to be done 
and appropriate resources were made available. Perceptions of support were 
strongly influenced by visibility. That is, if respondents came in contact 
with supporters or saw clear evidence of support they were more likely to 
give a favorable rating. If respondents received support "second-hand" 
they were more likely to credit the supporter they saw rather than another 
who may have initially developed or organized the support received. (See 
Table 5). ■ , 

Perceived impact is summarized in Table 6, with responses generally 
positive for this initial year of implementation. Since projects are for 
two years, assessment of impact will" not be formally made until 1983, 

At the end of the 1981-82^ school year needs and concerns of local 
implemented fell into four general categories; support, training, dissem- 
ination, and changes to the innovation. Also, about 24% o'f responses 
indicated that no changes were needed. Needs are summarized here. (These 
needs are to be addressed in the v second year, of implementation.) 

• . * « 

^ fL^ -Support needs were defined by respondents as demonstration of 
| ^commitment and involvement (especially from central office staff), 
V /Ikar communication (especially relating to guidelines or plans) , 
^provision of materials, planning time or provision of teacher 

substitutes or aides to allow for common planning. by participating 
J teachers, and problem-solving assistance for teachers. Most such 
^ needs were identified for AT and TV. About 15% or responses 

identified support needs* ' ' 

• Training or' inservice needs were identified by about 17% of the 
respondents, with most for AT arid ML. Several respondents said 
they would prefer to learn by inter-class or inter-school visits 
followed by "sharing sessions" rather than by formal workshops. 



■30 



Table 5 

Perceptions of Support Received, by Innovation and Role 



Sources of Support 



Active Teaching 
I 

xoum r~\ 

5&»t«srv Leaning 

CO 
S* 
T 

lOXAl 



5 



J Student »ea~ teaming 

SA 

J ror.\t 

; TcawSittiR Variables 
CO 

I If 
5 wru 



CO 
T 

TOTAL 



Teachers 



.Topics and KeapowJonttJ N 



School 
Adainlstrntors 



7 


4 0 12 


21 j 


3.76 


98 




126 


3.54 



7 
S 
53 
68 



7 J 

* I 
37 | 

52 I 



6 
5 

16 



17 ! 

42 | 
204 J 
273 i 



4.43 
4.25 
3,39 
3.59 



4,43 
4*43 
3.66 
3.38 



4.50 
4.60 
3.56 
3.96 



i e 36 
4.08 
3,48 
3.66 



4:12 

4.00 
3*67 
3.74 



4.14 
4.67 
3. 59 
3.75 



3.66 

4.tm 

3.00 
3*91 



4,50 
4.25 
3.50 
3.S5 



4.14 
4.16 
3.67 
3.78 



Central Offlct 
Staff 



MS0E n Dcvaloptr* 



4.14 
3,75 
3*66 
3.20 



4.00 
4,7* 
3.11 
3.39 



4.40 
4 CO 
3,14 

3.*r 



4.C0 
3.40 
2,81 
3.19 



4.14 
3**5 
3.36 
3*52 



4.00 
3.56 
2.88 
3.09 



3*71 ; 

4*50 ; 

3.13 J 

3.35 '\ 



4.57 
4.64 
3.90 
4.07 



3/67 
4.i0 
3.25 
3.56 



.4.00 
4.01 
3.16 
3.39 



3.57 
3.50 
2.96 
3.09 



4.14 
4.50 
1.14 
3.40 



4.71 
4,H 
4.08 
4.17 



3.33 
4.00 
3.19 

3,37 



3.96 
3.87 
3.23 
3.40 



Mean ratings range from a low of 1.00 (very poor) to a high of 5.00 (excellent) 



31 



Table 6 • , 

Impact of Innovations as Perceived "by Active Impleraenters (June 1982) 









Active Teaching 


Mastery Lenrnliifc 


Student Te«io hcaroiof* 


Teaching Variable** 




Over al 1 








CO 


SA 


T 


Total 


CO 


SA 


T 


Total 


CO 


SA 


T 


Total 


CO 


SA 


T 


Tata 1 


<!(* 


SSA 


T 


Total 






9 


27 


125 


m 


8 


8 


56 


72 


7 


9 


38 


5A 


6 


5 


16 


27 


30 


49 


235 




tn**t r iti t tonal v.i lite 












































It l« worthwhile /workable. 

li I* rtnrft work that It** worth. 




4.67 


4,48 
1.70 


4.28 


4.33 
1.97 


A. 37 
2.7$ 


A, 81 
2.38 


3.89 
3.00 


4.05 
2.90 


4,71 
1.86 


'..70 


4,22 
2!o3 


A. 36 
2*04 


4.16 
1.83 


A.35 
2.20 


3.81 
2.56 


3. 98 v 
t. 33 


'«.50 
2.00 


4.56 
1.96 


4.14 
2.31 


4.24 
2.22 * 














































vitjov It. 
T** fill ii knowledge?. 
T*. ittwrciNtf likUls, 




3.89 
4.11 
4.J3 


3.21 
3.93 
VOfi 


1.60 
3,53 
3.65 


3.65 
3,63 
3.74 


4.00 
4.63 
4.25 


A. 13 
A. 63 
A. 50 


3.48 
3.63 
3.49 


-3Wil 
1.85 
3.69 


4,5? 
4.24 
'.,00 


4.12 
A. 44 
4.25 


3.92 
A. (8 
3.95 


A. 06 
4.22 
4,00 


3.5fr 
4,17 
A, 17 


3.80 
4.20 
A. 25 


3.07 
3.75 
3.69 


3*31 
3;97 
3.89 


4.00 
4.27 
4.17 


3.61 
A. 17 
4.13 


3.59 
3.67 
3,66 


3.68 
3.81 
3.79 










































i 




S** ifiin'r it. 

W ire n««rc Involve*! inPvwJt. 




3,89 
4 * A A 
3.5« 


J. 6? 
'i.30 
1.62 


3.82 
3.8^ 
i.Su 


3.80 
3.93 
i.52 


4,00 
3,75 
3.56 


4.38 
4.13 
3.7) 


3.74 
3,53 
3.37 


1.84 

1,62 
J. 46 


4.86 
A.A'S 
3.79 


4.78 
A. 13 
$.95 


4.32 
A. 00 
3.64 


4.46 
4.08 
3.70 


3,00 
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• While about 21% of responses (about evenly spread across processes) 
recommended dissemination for expansion of topic implementation to 
other classes or schools or by use of other variables (TV) or 
methods (STL) , about 3% suggested that implementation, should stop 
or that processes should be used only by volunteers* 

* Changes to the topic were recommended by about 24% — all for AT.. 
It is, likely that this group of respondents needs more accurate 
information about the. relative flexibility of the process; and they 
may also need to be involved in activities to increase commitment. 

Roles and ^Responsibilities of Central Office Staff / * 

■ Central office staff roles and responsibilities are summarized in , 

t^rms of planning, training, and implementation, 

\ Planning , LEA superintendents reviewed state plans in the fall of 

19^0 and made choices basetf on the extent to which SITIP appes ,ed to relate 

to local priorities. Subsequently, central office (CO) staff were invited 

to participate in the three planning activities initiated by MSDE i (proposal 

writing, spring and fall planning meetings) , and encouraged to apply 

principles such as cross-hierarchical decisionmaking and; interactive 

support*. Unless local plans specified school-based leadership (as happened 

in one LEA) it was assumed that central office staff would be involved in 

all planning activities. With one exception, all LEAs involved CO staff in 

proposal writing; thirteen LEAs (68.42%) involved CO staff in spring and « 

fall planning sessions. Low involvement in planning by CO. -staff caused 

problems (two LEAs — school staff discontent) only when ,, two issues were 

not clearly understood and agreed upon; 1) the implementation strategy and 

its implications, or 2) leadership — responsibility for trouble-shooting 

and providing support to teachers. Such misunderstanding,, caused by poor 

communication during planning, had negative effects during implementation, 

in two LEAs. ■ 
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Training , LEA, superintendents agreed to send cross-hierarchical teams 
to the three kinds of training events conducted by MSDE, Inmost cases * 
• this: occurred CO staff from all 19 LEAs attended Awareness Conferences, 
CO staff from 17 LEAs attended Summer Institutes, an4 CO staff from 16 liEAs 
attended follow-up sessions. With the exception of one LEA, all LEAs sent 
CO staff to at least two training events. Lack of involvement in training > 
by CO staff at that site caused no problems since leadership was assumed by 
the school principal; 

' Implementation . Levels of effort invested by CO staff in six areas of 
activity are presented in Table 7, with levels ranging from 1.53 (materials 
development) to 4,13 (support), Ovetall patterns are similar across 
innovations, with the least difference for inserVice, Time spent on SITIP 
in comparison to other similar projects (see Table 8) was about the same 
for materials development (all innovations), but slightly more demanding in 
terms of becoming informed and interacting with school staff (all innova- 
tions except STL), and for record keeping and evaluation (AT and TV), STL 
took about the same amount of time as other projects-* 

For interactive support, CO staff consistently awarded high ratings, 
placing themselves first only for AT. Average or below average ratings 
were awarded to CO staff for ML, STL, and TV by teachers. Active CO 
support encouraged school level implementation 1 and plans for expansion. 

In general', lack of support and involvement of CO staff did not 
prevent implementatibn if leadership was assumed at the sphool site and if 
CO staff did not then hinder that leadership. However, school- staff 
involved in the more complex innovations or employing strategies other than 
the "lighthouse school 11 wanted to share the workload with CO staff, and if 
support was low, 'scope of implementation decreased. 
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Table 7 . " ; . 

t 

Level of Effort: Central Of f ice Staff 
(All Innovations) 




Mean ratings range from a low Tsf 0 (none) to a high of 5 (a great deal) 

_ _ Active leaching . Student Team Learning 

• Mastery Learning ;.. Teaching Variables 
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Table 8 



Time Spent in Comparison to Other Projects: 
Central Office St^ff 




Mean ratings range from a low of 1.00 (substantially less time) to 
a high of 5*00 (substantially more time) . * .., . * 



_ _ Active Teaching 
.»,,.,,.•«• Mastery Learning 



Student Team Learning 
». Teaching Variables 



Summary , A generally effective CO role was that of resource coordina- 
tor, especially in approving. release time, arranging for inservice, or 
providing support services such as data processing or trouble-shooting 
assistance. Also, effective CO staff vera. general coordinators, linking 
across school sites and between SEA and LEA td ensure accurate and timely 
communication, and acknowledgement of the value of SIXIP activities. When 
the selected implementation strategy was not a "lighthouse school, 11 CO 
staff needed to provide leadership if the project was to succeed* 
Roles and Responsibilities of School-Based Administrators 

Roles and responsibilities of school-based administrators (SAs) are 
summarized here in terms of planning, training, and implementation. 

Planning ,, With the exception of four counties, all LEAs involved SAs 
in at least two of the three SEA~iiiitiated planning activities. In two of 
those four LEAs, 'principals were reassigned during or just prior to imple- 
mentation. The new principals were brought up to date by both teachers and 
CO staff. No problems were apparently caused by low involvement in planning 
by SAs, However, it should be noted that at all four sites with low involve 
ment, local plans required leadership either from CO staff or from teacher- 
coordinators, rather than from school administrators. 

Training , With the exception of two sites, all LEAs sent SAs to at 
least two of the three kinds of SEA-sponsored training events, although 
there was slightly less SA participation in the summer* institutes than in 
awareness conferences or follow-up sessions. Lack of SA involvement in 
training caused no problems at the capacity-building site since leadership 
and staff development responsibilities were assumed by CO staff. At the 




lighthouse site, teachers expressed concern over lack of administrative 
support which may have been influenced fay. the fact that the principal 
attended only the awareness conference. 

Implementation. Levels of effort, invested by SAs in six areas of 
activity are presented in Table 9. For 'all innovations investments were 
similar for materials development, training, and support, and for three 
innovations were similar for administration. Small differences were 
apparent for dissemination and evaluation. SITIP took more time than other 
similar projects for all activity areas except materials development (AT) , 
record keeping (AT) , and evaluation (AT and TV), with most investment in 
becoming informed about STL.. (See Table 10.) In six of the 65 SITIP 
schools (46% of the lighthouse schooi sites) project leadership was assumed 
by principals. 

For interactive support, SAs cdnsistently awarded fairly high ratings, 
perceiving teachers as slightly less supportive than themselves for AT and 
ML and more supportive for STL and TV, and finding CO staff more supportive 
for ML, equal to themselves for STL, and less for AT and TV. Combined 
ratings gave SAs highest scores for all* innovations. except TV. (see Table 
5.) . / 

Summary'. A generally effective SA role wa's that of supportive facili- 
tator or manager, ensuring that teachers' personal concerns were addressed, 
that logistical matters were taken care' of , and demonstrating sincere 
interest in. and appreciation of teachers' activities. The more complex the 
innovation, the more important it was for school administrators to provide 
active support. 



Table. 9 



Levels of Effort: School Administrators 
(All Innovations) 
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Table 10 

Time Spent in Comparison to Other Projects: 
School Administrators 




Mean ratings range from a low of 1.00 (substantially less time) to 
a high of 5-00 (substantially more time)* 

J Active Teaching _ _ _ Student Team Learning 

Mastery Learning Teaching Variables 



Roles and Responsibilities of teachers 

-Teacher responsibilities are summarised in terras of planning* training, 
and implementation. 

Planning , Cross-hierarchical participation in the three SEA-initiated 
planning activities (proposal writing, Spring and fall planning meetings) 
was encouraged by MSDE. - Withjhe exception of four counties {five topic 
sites), all LEAs involved teachers in at least two planning activities* In 
those LEAs with low teacher involvement in planning, problems appeared in 
two. cases, both relating to teachers 11 personal concerns about the impact 
and demands of the innovations, and resulting in resistance to implementa- 
tion. To some extent, these concerns were alleviated by on-site training 
and assistance provided by school administrators and developers* 

. TraitlinR . LEA superintendents agreed to include teachers as part of 
the LEA team sent to the three SEA-sponsored training events (awareness „ 
conferences, summer institutes, and follow-up sessions), JU.1 the LEAs sent 
teachers to at least £wo of the three training events, usually the summer 
institutes and follow-ups. 

Implementation . Teacher time spent on SITIP in comparison to other 
similar projects is presented in Table 11, Teachers found that all topics 
required more time in all five activity areas, with ML most demanding ijh, „ 
all areas. The most demanding activity for AT and TV was becoming informed 
and for ML and STL was preparing or organizing materials. The least 
demanding activity was evaluation for AT, ML, and STL and preparing or 
organizing materials for TV. . 

42 



Table '11 

Time Spent in Comparison to Other Projects: 
^ Teachers 



1 



H 

n 



c o 

e . 

o o 

o c 

C3 ►«* 



C 

o 
u 
a 



o a 
u a 
a o 



c 
o 

-3- 

a 

> 




Mean ratings range from a lo*r of 1,00 (substantially less dime) to 
a higb-of 5.00 (substantially more time). 
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For interactive support, teachers, consistently awarded lower ratings 
to all support sources than did other role group, and for all innovations 
except TV they rated other ( teachers as less supportive than school admini- 
strators. Nearly all ratings indicate that each role groups provided very 
good to excellent support. However, teachers gave average or below average 
ratings to other teachers for AT and ML and to central office staff for ML, 
STL, and TV. Combined ratings across the role groups awarded teachers 
highest in support for TV and , second highest for all other innovations. 
(TV was the only innovation actually requiring teacher interaction.) 

In several cases teachers who had attended SEA~sponsored training 
subsequently trained others in their LEA. While this was organizationally 
effective and gave those trainer-teachers recognition, the people involved 
were reluctant to be puiled'away from "their regular classes too often. 
Another task that Was demanding for teachers was curriculum and test 
development or revision required for ML. Without team common planning time 
and/or help from SAs.or CO staff for this task, teachers' concerns escalated; 

For an innovation to be successfully implemented, each site needed a 
process! advocate or team perceived by local participants as being "in 

charge." Seven LEAs had teachers as process advocates. These teacher- 

s. 

coordinators were present in eight schools and across all four innovations. 
Five of these coordinators previously held positions of authority and three 
"evolved" into the .leadership role. In all cases they provided the "energy" 
to keep implementation going, and in several cases they developed methods 
or systems to facilitate implementation. 
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Summary. Teachers not only implemented the instructional processes in 
their classrooms* but were also involved in materials development (mostly 
ML) and training (mostly STL) . At seven LEAs (eight school sites) teachers 

assumed leadership, roles, taking responsibility for "energizing" and 

) v 

organizing Implementation within that school. 

■~" • . \ 

V • • ■ 

/ Conclusions 
For statewide instructional improvement, it appears that effective - 
roles are as follows: 

» SEA staff initiate, encourage voluntary participation, build and 
maintain commitment, and provide (research-based) assistance as 
resource coordinators. 

• Central office staff engage in cross-hierarchical communication, 
linking schools and LEA to SEA, and act as resource coordinators by 

, ■ providing various support services. If Implementation is in more 
than one school, CO staff function as "project directors." 

• School-based, administrators ensure that teachers' concerns are. 
addressed (logistical and affective), and function as supportive 
facilitators or managers, sometimes with "project director" status 
if a "lighthouse school" strategy is used. 

• Teachers carry out classroom implementation tasks. Also, teacher 
representatives support others by "turnkey training" especially for 
capacity building sites, and, when implementation is single-school 
focused, teachers can function as "project directors" if admini- 
strators (school or central office) do not take on that responsi- 
bility. r 

Other findings of this study, relevant to role group responsibilities 
suggest the following conclusions: 

.._ *__I^ it i a L 1 staf * interest or commitment to implement a new program pr 
practice can be built if: 1) the LEA superintendent permits staff 
to look at new ideas with the intent to implement if appropriate, 
2) the innovation and its presenter/developer have validity and 
credibility, and 3) staff believe that they do ha, • choices and can 
influence decisions. 
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Staff interest (of all role groups, but particularly those that 
have the mo-st work to do) is the most important factor in selection 
of the innovation and in determination of elements of the impleraenr 
tat ion plan* 

Cross-hierarchical planning facilitates mutual Understanding which 
.helps to prevent problems during implementation (such as communica- 
tion breakdowns, resentment, feelings of isolation)* 

'« 

Representation of the various role groups, in planning and subsequent 
decision-making builds understanding and commitment, ensures inclu-- 
sion of role group perspectives, and strengthens organizational 
knowledge so that if reassignments are made knowledge is not lost 
and new staff will not be given a one-sided briefing. 

The complexity of the innovation determines the amount of work to 
be done for a given school site. 

The implementation strategy determines how the work is shared among 
role groups and how the burdens shift among role groups over time. 

The implementation strategy plus the scope (number of schools, 
teachers, curricula* subjects, grade levels, amount of time for the 
innovation to be used for each class or subject) determine how much 
work is to be done within a given LEA, ■ * 

The nature and extent of communication and decision-making determine 
productivity and affect. * 

The organizational norms of the LEA. determine communication and 
decision-making procedures. 

Changes in organizational norms, are influenced by two forces, acting 
almost simultaneously but not necessarily collaboratively: external 
"pressures, " e.g., TA recommendations; and internal "pressures," 
e*g*, topic advocate recommendations or teachers 1 concerns* 

Regardless of the nature of the innovation all role groups must 
carry out certain tasks which are, in ojrder of investment: 1) 
interactive support (acknowledgement, shared knowledge, problem- 
solving, resource allocation); 2) learning/trainixvg (before and 
during implementation^ 3) record keeping; 4) materials identificaV 
tion or development; 5) evaluation; and 6) administration. 

c 

Perceptions of interactive support reflect participants 1 assessment 
•of each others' commitment. Judgements are based not only on how 
much useful hel^ was provided but also on the visibility of the 
supporter (with lower ratings for low visibility) . 
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# It is preferable for each role group to perceive high support from 
close role groups rather than distant ones. Therefore, visibility 
should be reduced with distance (e.g., Teachers should perceive 
principals as supportive. If thejre is a problem a state TA m/xy 
help central office staff (who turnkey ideas to the principal) or 
the TA (wit]ti central office permission) may help the principal. 
But the state TA does not provide support to the teachers when it 
.should more appropriately come from the principal). 

# Representatives of all role groups need a thorough understanding of 
innovations to be adopted so that: 1) plans are realistic, 2) re- 

% assignment do not result in the grganization's loss of knowledge, 
* 3) interactive support can occur, 4) no, one group is overburdened, 

and' 5) there is a reasonable chance for institutionalization and 

dissemination beyond initial pilot sites. 

» Impact in terms of student ^achievement was evident to spme extent, 
although not formally expected for the first year of implementation, 
Results suggest (tentatively) that greatest' impact was made by 
Mastery Learning, followed by* Active Teaching. Student Team 
Learning appeared to influence student affects more than achieve- 
ment. Teaching Variables data are inconclusive. 

m* People providing technical -assistance (TA) are most effective when 
they are: 1) responsive to the needs of the group (of , implementers) , 
2) task oriented and knowledgeable about local norms, the innovation, 
and processes of planned change, and 3) skillful in facilitating 
shared decision-making and coordinated communication. 

# Designs or plans for instructional ; improvement are most likely to 
H be successful if: 1) participation (of organizations) is voluntary, 
2) communication is inulti-dimensiorial, 3) planning is interactive 
with training, 4) training and technical assistance are provided 
during implementation, 5) ,f lip service compliance" is not accepted 
as implementation, 6) adjustments of scope are considered legitimate 

' and relate to resources available, and 7) feach participant has some 
degree of choice about his or her involvement (nature or extent) in 
the effort. These elements were present in SITIP. 
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